METHOD, SYSTEM, AND STORAGE MEDIUM FOR SEARCHING MULTIPLE 
QUEUES FOR PRIORITIZED WORK ELEMENTS 

CROSS-REFERENCE TO RELATED APPLICATION 

[0001] This application is related to and incorporates integrating processing 

functions as provided in U.S. patent application entitled "METHOD, SYSTEM, AND 
STORAGE MEDIUM FOR MANAGING COMPUTER PROCESSING FUNCTIONS, 
attorney docket number POU920040048US1, filed concurrently with this application. 

BACKGROUND OF INVENTION 

[0002] The present invention relates generally to workload management, and in 

particular, to searching multiple queues for prioritized work elements. 

[0003] In modern operating systems, the next work element to schedule on a 

processor should be available without excessive searching of a list of possible work 
elements that may or may not be ready to use the processor. U.S. Patent 4,807,1 1 1 is an 
example of a queuing discipline that achieves this objective. Unique characteristics of 
certain processors may dictate that they service a queue of work elements requiring that 
unique capability to avoid searching the general work queue when the percentage of work 
elements requiring the capability may be relatively small. An example of this is the 
management of S390® processors with a vector processor or a cryptographic processor. 
In the case of the latter, the processors with the cryptographic feature service a processor 
work queue of elements requiring the cryptographic feature before searching the general 
work queue. 

[0004] There may be valid reasons for segregating certain types of work to certain 

processors for improved performance or for pricing considerations. In the latter case, all 
processors are capable of servicing the work but only a subset is the primary source of 
processor for the work. In this case two or more queues of work are populated regularly. 
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If the distribution of work to the queues is not optimal, it would be desirable to have a 
processor search two or more queues with consideration for priority during the search. 

SUMMARY OF INVENTION 

[0005] An aspect of the invention is a method of searching for work elements for 

processing in a computing system having a primary queue of work elements and at least 
one secondary queue of work elements. A numerical priority value is associated with 
each of the work elements. The method includes setting an initial priority bar and 
processing work elements from the primary queue until reaching a work element having a 
priority less than the initial priority bar. A priority bar is set equal to a minimum of a 
priority limit and a priority on the at least one secondary queue. If the primary queue 
contains a work element having a priority greater than or equal to the priority bar, then the 
work element is processed. If the primary queue contains a work element having a 
priority less than the priority bar, then a work element from the at least one secondary 
queue is processed. 

[0006] Another aspect of the invention is a system for searching queued work 

elements for processing. The system includes a primary queue of work elements, a 
numerical priority value being associated with each of the work elements. The system 
further includes at least one secondary queue of work elements, a numerical priority value 
being associated with each of the work elements. A processor is in communication with 
the primary queue and the at least one secondary queue. The processor sets an initial 
priority bar and processes work elements from said primary queue until reaching a work 
element having a priority less than the initial priority bar. The processor sets a priority 
bar equal to a minimum of a priority limit and a priority on the at least one secondary 
queue. If the primary queue contains a work element having a priority greater than or 
equal to the priority bar, the processor processes the work element. If the primary queue 
contains a work element having a priority less than the priority bar, the processor 
processes a work element from the at least one secondary queue. 
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[0007] Another aspect of the invention is a storage medium encoded with 

machine-readable computer program code for searching queued work elements for 
processing a primary queue of work elements and at least one secondary queue of work 
elements. A numerical priority value is associated with each of said work elements. The 
storage medium includes instructions for causing a processor to perform a process that 
includes setting an initial priority bar and processing work elements from the primary 
queue until reaching a work element having a priority less than the initial priority bar. A 
priority bar is set equal to a minimum of a priority limit and a priority on the at least one 
secondary queue. If the primary queue contains a work element having a priority greater 
than or equal to the priority bar, then the work element is processed. If the primary queue 
contains a work element having a priority less than the priority bar, then a work element 
from the at least one secondary queue is processed. 

BRIEF DESCRIPTION OF DRAWINGS 



[0008] Referring to the exemplary drawings wherein like elements are numbered 

alike in the several FIGURES: 

[0009] Figure 1 is a diagram of an exemplary system for prioritizing work 

elements across a plurality of queues; 

[0010] Figure 2 is a flowchart of an exemplary process for prioritizing work 

elements across a plurality of queues; 

[001 1] Figure 3 depicts three exemplary queues; 

[0012] Figure 4 depicts the prioritization of the queues of Figure 3; 

[0013] Figure 5 depicts three exemplary queues; 

[0014] Figures 6A and 6B depict the prioritization of the queues of Figure 5; and 
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[0015] Figure 7 depicts prioritization of work elements in a system having general 

processors and special purpose processors. 

DETAILED DESCRIPTION 

[0016] Figure 1 is a block diagram of a system for prioritizing work elements 

across multiple queues. The system includes a processor 12 in communication with 
multiple queues 14. Processor 12 may be implemented using many types of devices. For 
example, processor 12 may be a microprocessor executing instruction streams represented 
by elements of work buffered in queues 14. In other embodiments, processor 12 is a 
database manager accessing data elements from queues 14. Thus, the term processor is 
not limited to microprocessors, but includes a variety of devices processing work 
elements from queues 14. The queues may be arranged in a hierarchy of preference such 
that queue 14 \ is a primary queue, queue 142 is a secondary queue and queue 143 is a 
tertiary queue. Work elements in the queues are arranged in order of priority, from high 
to low. The priority may be represented with a numerical value, with either a high or low 
numerical value indicating a high priority. The processor 12 operates in response to a 
computer program contain in a storage medium accessible by processor 12. 

[0017] Figure 2 is a flowchart of a process for prioritizing work elements across 

multiple queues. The process begins at step 20 where a priority limit is set. The priority 
limit indicates a priority of elements on the primary queue 14 \ that must be reached 
before the elements of the secondary queue 14 2 are eligible to be processed. Before 
searching the primary queue 14i, the other queues 14 2 and 14^ are accessed. As part of 
the initialization, the primary queue is designated the current queue at step 22. 

[0018] At step 24 a priority vector is generated containing the maximum priority 

value for each of the queues 14i -14 3 . Each queue is accessed by processor 12 at this time 
to determine the maximum priority work element in each queue. Initially, the vector 
value for the primary queue is set to 0. In the present example, the priority vector is 
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(0,max _j>rty 2 , max _prty 3 ). Once the priority vector is created, a priority bar is determined 
at step 26. The priority bar is determined based on the minimum of the priority limit and 
the maximum value in the priority vector. Represented mathematically, the priority bar 
equals minimum(priority limit, maximum(priority vector)). 

[0019] At step 28, the current queue is searched to find a work element to be 

processed. If a work element is found, flow proceeds to step 30 where it is determined if 
the priority of the work element is greater than or equal to the priority bar. If so, the work 
element is processed at step 32 and flow returns to step 28. 

[0020] If no work element is found in the current queue (i.e., initially the primary 

queue) at step 28, the flow proceeds to step 34 where the maximum priority for the 
current queue is set to -1 . This prevents an empty queue from being considered in the 
search of queues and optimizes the processing. Flow then proceeds to step 36 where the 
priority vector is re-defmed. Further, if the work element considered at step 30 has a 
priority lower than the priority bar, this indicates that the work element should not be 
processed as its priority is not sufficient. Flow proceeds to step 36 where the priority 
vector is re-defined. 

[0021] At step 36, the priority vector is updated with the maximum priority values 

for the current queue and is represented as (maxjprtyi, max _prty2, max_prty3). Flow 
proceeds to step 38 where the current queue is defined as the queue having the maximum 
priority value. Flow proceeds to step 28 to search the new queue. 

[0022] Figure 3 depicts primary queue 14i, secondary queue 14 2 and tertiary 

queue 14 3 in one example. Figure 4 depicts the processing of work elements in these 
queues. At step 50 the current queue is set to the primary queue and the priority limit is 
set to 200 at step 52. At step 54 the priority vector is defined using 0 for the primary 
queue priority value and the maximum priority values from the secondary and tertiary 
queues, 210 and 183 respectively. 
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[0023] At step 56, the priority bar is determined as described above and is set at 

200. At step 58, a work element is retrieved from the primary queue 14i and the priority 
of the work element is compared to the priority bar. Since the priority of the unit of work, 
240, is greater than the priority bar, 200, the unit of work, referenced as PI is processed at 
step 62. 

[0024] Figure 5 depicts the primary queue 14\ 9 secondary queue 142 and tertiary 

queue 14 3 in another example. Figures 6 A and 6B are a flowchart depicting the 
processing of work elements in these queues. At step 70, the current queue is set to the 
primary queue 14i and the priority limit is set to 200 at step 72. As described previously, 
the priority vector is defined at step 74 using 0 for the primary queue priority value. At 
step 76 the priority bar is redefined as the minimum of the priority limit and the 
maximum value in the priority vector. Represented mathematically, the priority bar 
equals minimum(priority limit, maximum(priority vector)). 

[0025] At step 78, a work element is selected from the current queue and the 

priority of the work element is compared to the priority bar at step 80. As the priority of 
the work element is not greater than or equal to the priority bar, the work element is not 
processed and a new priority vector is derived as shown at step 82. The new priority 
vector is defined based on the maximum priority values from each of the queues. The 
processor 12 stores the previously retrieved maximum priority values for queues 142 and 
14 3 so that these queues need not be accessed again to redefine the priority vector. 

[0026] At step 84, a work element is retrieved from another queue, is this case the 

secondary queue 14 2 is defined as the current queue. The determination of the new 
current queue may be based on the hierarchical arrangement of the queues (e.g., 
secondary always checked before tertiary). Alternatively, the determination of the current 
queue may be based on the queue having a work element having the maximum priority 
value of the remaining queues. At step 86, a work element is retrieved from the current 
queue (i.e., secondary queue 14 2 ), and the priority of the work element is compared to the 
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priority bar at step 88. It is noted that the priority of the work element in secondary queue 
14 2 has changed from 210 to 166 as a result of another processor accessing the work 
element having priority 210. Again, the priority bar is defined as the as the minimum of 
the priority limit and the maximum value in the priority vector. 

[0027] As shown at step 88, the highest priority work element in the secondary 

queuel42 has a priority less than the priority bar. Flow proceeds to step 92 where the 
priority vector is redefined based on the highest priority values in each of the queues. As 
shown in step 92, the maximum priority work unit from secondary queue 14 2 has changed 
from 210 to 166, as another processor has accessed and processed the work element 
having the priority 210. At step 94, the priority bar is established based on the maximum 
priority value across all queues, without considering the priority limit. It is noted that in 
alternate embodiments, the priority limit may be used as described in step 76. 

[0028] At step 96, the tertiary queue is defined as the new current queue and a 

unit of work, Tl, is selected from the tertiary queue 14$ at step 98. At step 100, the 
priority of the work element from the tertiary queue is compared to the priority bar. Since 
the priority of the work element is greater than or equal to the priority bar, the work 
element Tl is processed at 102. 

[0029] As described above, embodiments of the invention allow work elements to 

be prioritized across multiple queues. The priority value has been described as a high 
number for a high priority, but a converse relationship may be used where a low number 
corresponds to a high priority. The priority scheme optimizes the search of the primary 
queue since the priority bar allows continuing as necessary on the primary queue until a 
priority is reached that is less than the priority bar, at which time the primary queue 
search is stopped and the secondary queue(s) are searched. If the priority limit is set to 
the lowest priority recognized in the system, it would effectively stop selection of 
elements from any alternate queue(s) until all elements on the primary queue were 
selected. On the other hand, if the priority limit were set to the highest priority 
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recognized in the system, the selection across the queues would be in priority order with 
the only bias being the order of the queues (i.e., primary, secondary, tertiary). If the 
priorities of elements are set by relatively static rules by an administrator, the priority 
limit could also be set to a relatively static value. In alternate embodiments, the priority 
limit may be programmatically set based on observed results in a goal oriented 
management system such as the workload manager (WLM) of zOS® operating system. 

[0030] The priority management aspects of the invention may be incorporated 

into a goal oriented management system such as WLM as described by IBM US Patent 
5,473,773. The goal oriented manager can set the priority limit based on the available 
resources and the goals without the need for other means to set the limits. The priority 
limit may be set by some other means such as a static setting via some other source. 

[0031] Figure 7 depicts prioritization of work elements in a system having general 

processors and special purpose processors. Queue 14\ contains general work elements 
and queue 14 2 contains special purpose work elements (e.g., Java work elements). The 
system includes general purpose processors 120 that process general work elements and 
special purpose work elements. Special purpose processors 122 process only special 
purpose work elements in queue 14j. In the example shown in Figure 7, the priority limit 
is set to 60. This causes general processors 120 to ignore higher priority elements with 
priorities 180 and 120 in the special purpose queue 14 2 . The limit keeps the less plentiful 
processors from processing high priority work that can be done by special processors until 
the general processors reach discretionary work at which point the general processors 
process general and special work in priority order. 

[0032] As described above, the present invention can be embodied in the form of 

computer-implemented processes and apparatuses for practicing those processes. The 
present invention can also be embodied in the form of computer program code containing 
instructions embodied in tangible media, such as floppy diskettes, CD-ROMs, hard 
drives, or any other computer-readable storage medium, wherein, when the computer 
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program code is loaded into and executed by a computer, the computer becomes an 
apparatus for practicing the invention. The present invention can also be embodied in the 
form of computer program code, for example, whether stored in a storage medium, 
loaded into and/or executed by a computer, or transmitted over some transmission 
medium, such as over electrical wiring or cabling, through fiber optics, or via 
electromagnetic radiation, wherein, when the computer program code is loaded into and 
executed by a computer, the computer becomes an apparatus for practicing the invention. 
When implemented on a general-purpose microprocessor, the computer program code 
segments configure the microprocessor to create specific logic circuits. 

[0033] While the invention has been described with reference to exemplary 

embodiments, it will be understood by those skilled in the art that various changes may be 
made and equivalents may be substituted for elements thereof without departing from the 
scope of the invention. In addition, many modifications may be made to adapt a 
particular situation or material to the teachings of the invention without departing from 
the essential scope thereof. Therefore, it is intended that the invention not be limited to 
the particular embodiments disclosed for carrying out this invention, but that the 
invention will include all embodiments falling within the scope of the claims. 
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